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ABSTRACT 


In this paper we consider the analysis of stod astic dynamical systems 
that involve multiplicative (bilinear) noise processes» After defining the 
systems of Interest, we consider the evolution of the moments of such systems, 
the question of stochastic stability, and estimatioi for bilinear stochastic 
systems. Both exact and approximate methods of analysis are introduced, and, 
in particular, the uses of L;le<-theoretic concepts ard harmonic analysis are 
discussed* 
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I . INTRODUCTION 

S;- 

lafhavrCn d^ve^opeH^r 

The reader ifr-rcfr.rrxiji m m « stochastic systems, 

II- STOCHASTIC BILINEAR SYSTEMS 
We consider the dynamical model 

N 

Xft) = (A^ + u^(t) A^]x(t) 


(1) 


vherc the A. are given n x n matrices, the u. are scalar inputs, and x is 

erther an n-vecror or ^ n x n matrix. Let the Lie , algebra venerated 

0' smallest subspace of n x n matrices containing 

Ao,...,A^ and Closed under the commutator product [P,Q] = PQ-QP-and let 

G be the Lie group associated v?ith i o n 

^trxx multiplication) containing exp (L) V L E I’ it If wIlH '“‘'f 
for precewrse continuous u., we have x (t) t G l!o) . "^1 


If the u are 
- 1 


white noise processes, we have that x f r^(n\ v ^ 

solution to the Ito equation ^ ^ the 


<ix(t) = {(A...+ ~ 
2 . 


? ■ ' N 

• ■*’ I A dv (t)} X(t) 

i,j-l -* 1 1 


(2) 


v^her- V IS a Brcmian notion v/i -:h r; I mv ( t ) dv * (f ) 1 - m 

smoo ;her than white noise - ~ for’inntanco if u „.t i 1 i 
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(3) 


dCCt) = FCt)^(t)dt + G(t)dw(t) + a(t}dt, u(t) = H(t)C(t) 

where w is a Brownian motion. — we needn't include the correction term 
contained in (2). In this case x is not a Markov process, but the pair 
(x,0 isy however, when we regard (x, Q as the state, the system (1),(3) 
involves products of state variables. As we shall see, the analysis in 
this case is more difficult than in the white noise case. 


III. MOMENT EVOLUTION EQUATIONS 

3.1 Systems Driven by White Noise 

In this subsection we present moment equations derived by Brockett 
[4]. Consider (2) where, for simplicity, we assume that R(t) « I. Recall 
that the number of linearly independent homogeneous polynomials of degree 

p 

p in n variables (i.e. f(cx,,...,cx ) * c f(x-,...,x ) ) is 

1 n I n 


n+p-1 


N(n,p) 


(4) 


We choose a basis for this space of polynomials consisting of the elements 


If we denote the vector of these elements (ordered lexicographically) by 

I l„[p] M ... . 11 I i2 


, v;here | x|.| » x'x. It is clear that if x 


x^^^ , then I |x| = | |a | 

satisfies x * Ax, then x^^^ satisfies x^^^ * We t;egard this as ■ 

the definition. of A^^^ , which is closely related to Krbnecker sum matrices 

[ 10 ], [ 11 ]. 

The Stratonovich analog of (2) is 


N 


dx(t) = [A^dt + I A^dv. (t)]x(t) 
i“l 


( 6 ) 


since Stratonovich equations obey the rules of ordinary calculus, we obtain 

N 


dx 


[p] 


(t) =[a ^^^dt + I A/P^dv. (t) ] (t) 

L ^ ^ ^ J 


(7) 


Using the moment equations for Stratonovich equations, we have an evolution 
for the pth moments o:: (2) ; 


) = {A f (A. (t» 

dt 0 2 . 1 


(S) 


i=l 


3.2 Systems Driven b / Colored I Ioi£;e: Exact I'lxprc iniorr. 

Definition 1 ; We associate v/ith any Lie alg^ra jy its derived series 

^ is abelian if to} and is solvable if i0> for some n. 
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Tlieorem 1: 


A matrix Lie algebra is solvable if and only if there 

exists a nonsingular matrix P (possibly complex- vali^d) such that PAP xs 
upper triangular (zero belcw diagonal) for all AG- 

Proof; See D.33 • 

We now consider (1) where we assume that u is a zero mean Gaussian 
random process with E[u(t)u> (s)J - P(t,s) . Let ^he the Lie algebra gene- 
rated by A /A ,-*.jAjj. we claim that one can construct closed form expre- 
ssions for (t)3 if ^is solvable. Assuming that L is solvable (and 

that x(0) is independent of u) , we can obtain a closed form expression for 
the state transition matrix for (1), as a function of u. First we find 
the matrix P as in Theorem 1 such that each >= PA^P is upper triangular. 

Then ’’s can solve the equation 


Y (t,0) 
u 




N 

I 

i»l 


B.u. (t)3Y (t,0) , t '(0,0) 
X X u u 



( 10 ) 


by straightforward calculations (see the ex^ple in Subsection 4.2), and we 
compute 

x(t) = p"^'i'^(t,0)P x(0) 

and involves nothing nmre complicated than exponentials of integrals of 

components of u, polynomials in u, and various combinations/products, and 
integrals of such-quantities. Since u is Gaussian,, we can evaluate the 
expectations of such quantities in closed form (see Subsection 4.2) and. 
can t)ius obtain a closed form egression for Elx(t)]; We can also obtain 
closed form expressions for E[xtPl(t)], as consists of the same types 

of fui^ctionals of u (see [7]). 


3.3 Systems Driven bv C olored Noise— Approximate Analysis 

Considea the system (1) where u is given by (3) . In this section we 
describe an ,-pproxxmate method that can be used for moment analysis if 
is not solval^le. This approach is based on the truncation of the ciimmulan^ 
of a random process [14] and can be used for arbitrary nonlinear systems, 
although it : s particularly well-suited to systems with polynomial non- 
linearities. We will illustrate the approach by example and refer the 
reader to [1],[2], and [9] for more detailed discussions. 

Consider the. scaleir. example 

dx t) 

where E [dw (t) ) 
m^(t) 


= (XX (t)dt + px(t)dw(t) 

= dt. We compute [12] 

2 

= ctm„ (t) , = 2am., (t) + B m (t) 


(12) 


03) 


m- 


(t) = 3ctm^ (t) + 3B m.^ (t) 


where m. = E lx ) . 

From these equations it is clear that any attempt to study the properties 
of (13) must involve a truncation of the xnfxnLte set of coupled equations. 

As discussed in U1 and [14], the direct truncation method --sett ^g 
to zero all moments greater than some given order — can cause diffxculti. , 
hut the truncation of the cumulants — the coefficients of the Taylor 
series expansion of the logarithm of the characteristic function - i^ quite 
reasonablT^for instance, only the first two c-imulants are nonzero for 



Gaussian densities). By comparing terms in tde' series expansions for the 
characteristic function, one can compute relationships between the cumu-* 
lants and moments. For instance, the fourth 7umulant satisfies 







( 14 ) 


Thus if we assume “ 0 use (14) to expr !ss in terms of m^, i £. 3, 

we can use this approximation in the moment e [nations (13) . 

Finally, we note that the cumulants tech .iqne can be used to design 
suboptimal estimators for bilinear systems (s :e 12]) 


IV. STOCHASTIC STABILI' Tf 

A problem of considerable theoretical an. practical interest is the 
question of the stability of linear systems c> ntaining multiplicative 
noise processes. As discussed in f7] and [8], -uch systems often arise in 
linear feedback systems in which the actuator,, sensor, and feedback gains 
may be stochastic in nature. In this case, a model such as (1) arises, in 
which, the represent the random elements in the system. 


Definition 2 : A vector random process x is pth order stable if 

(t) ] is bounded for all t, and x is pth order asymptotically stable 
if 


lim E[x^^^(t)] * 0 (15) 

t-KO 


The systems (1) , (3) and (2) are pth order (asymptotically) stable if the 
solution X is pth order (asymptotically) stable for all initial conditiorP 
x(0) that are independent of ^ (in the (1) , (3) case) or the y. (in (2)) and 

such that E[x^°^(0)3 < “. 


4.1 The VJhite Moise Case 

Consider the system (2). Using (8), we have the following. 

. Theorem 2 : The system (2) with R=I is pth order asymptotically stable 

if and only if the matrix 


D 

P 




N r , 

I (A fP’)" 

_ -e ^ 


( 16 ) 


has all its eigenvalues in the left-half plane (Re(X)< 0). The system is 
pth order stable if has all its eigenvalues in Re(^£ 0 and if the 

eigenvalues with real parts = 0 have all higher order residues =* 0 (i.e. 
At 

there are no te terms in e ^ with Re(A) = 0; see [15, p.55]). 

For exairples of this result, we refer the reader to [7] . 


4,2. The Colored Uoise Case 

We have seen in Subsection 3.2 that we can obtain closed form noment 
expressions for systems of the form given in (1) whf;n u is a r;ai,is,'; i .m 
colored noise process and ^ is .solvahl f;. We can use thufio ex' 'rt.v.ir. i onr. t « j 
obtain stochastic stability criteria. V/e illustrate these ideas by ir»eariB 
of an example (see [7] for other examples). 


Example 1 : Consider the system 

x(t) ^ [Aq + + A 2 C 2 (t)Jx(t) 


( 17 ) 
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'0 


a 


2 -1 
1 0 

with ^ -:ero mean and 


oj ' ^ ^0 oj 


(18) 


-k, T 


E[c,(t)^(t+T)]=^[a^ 


2 ■*^2*'^ 


2 2 "^2 
e - O e 

2 


]. 

"]- 


i«l,2 


In this case L is solvable, and defining y «Px , with 
0 1 


P * 


We have 


1 -1 


y{t) » 


n^(t,o) 


0 


w 

I T\^(t,syT\^{s,0) [a + Cj^(s)]ds 


n^CtfO) 


= exp aCt^ 


2 

-t,) . J 5. 


(s)ds 


(19) 


( 20 ) 


( 21 ) 


( 22 ) 


(23) 


Some lengthy but straightfbrward calculations yield 'the following neces- 
sary and sufficient condition for first order asymptotic stability 
. / a ^ n 




(24) 


and the system is first order stable if equality holds in (24) . 

V. ESTIMATION FOR BILINEAR SYSTEMS 
There have been a number of results obtained on estimation for bili- 
near systems. In this section we illustrate tv’o classes of results. The 
first of thesd involves estimation on nilpotent Lie groups. For such sys- 
tems one can obtain finite dimensional optimal nonlinear filters [3] , and 
we illustrate the result for the 3-dimensional case in Subsection 5.1. 

An ajjproximate technique based on the use of harmonic analysis on compact 
Lie groups is illustrated in Subsection 5.2. For ntore detailed discussions 
of bilinear estimation, we refer the reader to [2 J , (3] , [5] , and [6]. 

5 . 1 Estimation on Nilpotent Lie Groups 

Definition 3; A Lie algebra 1 Ih called if the 

of Lie algebras 


0 


Se SB- 


n+1 


= [L , L”] - {(a,b]1a e i , b c i”}, n > o 


(25) 


terminates in zero. Note that abelian “> nilpot^t ■> solvable, but none 
of the reverse implications hold in general. 



Consider the system (1) with « 0, N=3, and 




0 10 


0 

0 1 ' 


0 0 0^ 

0 0 0 

' *2 “ 

0 

0 0 

f A « 

0 0 1 

0 0,0 


0 

0 0 

3 

0 0 0 


( 26 ) 


uaa.. «iese matrices generate a nilpotent Lie alaebra 
Also, suppose that u satisfies (3) with (for simplicity) H - I and a - 0 
^d let X be the 3x3 transition matrix for (1) (i.e. x(0) =* I) ' 


x(t) 


t "i 


I ^ (CO do J s^COdo + j I ^ 

0 0 o n 


1 

0 


0 


0 0 
^ (a) da 

1 


io) C3(a^)da2da, 


(27) 


Suppose we have the linear observations 

dz(t) = C(t) C(t)dt + R^''^(t)dv(t) ( 28 ) 

where v is a Brownian motion process and R > 0, Then the conditional 

»(t|t) -E(x(t)|a(s), 0 < s < t), can be generated by a finite 

dimensional nonlinear filter as follows (see [2] , [3] for StaiW: let 

= E[(C(CT^) - £(ajt)) (5(0 )- |(o |t)) ■ |z(s) ,o<s<t] „ , 

« ei — — (29) 

Then P(a,t,t) == k(t,a)J(t), and is nonrandom, where 


i “ + 1^' + gg* - Jc'r“"c5] 

-1 

K’(t,a) «-[F'(t) + J (t)G(t)G- (t)];.' (t,a) ; K(o,a) =i 
Consider the additional state variabies 
mt) = c(t) 

t 


6t(t) 


(t,c)ejdo 


0 


-1 


^(t)-[F'(t) + l (t)G(t)G* (t)]ct(t) 


“1 - 

$(t) = [e^e^ln(t)-tFMt) + I (t)r.(t)G* (:t)]R(t) 


(30) 

(31) 

(32) 

(33) 

(34) 


where n(0) = a(0) = 6(0) = 0, K. 1« t).e jth ..f K. and ip u,. 

ith uijit vector in R . We Kci Im.m f j j i nr f O , fwi 

(34 ) , and then 





1 r!^(tU) n^Ctlt) + Y(t|t) 


0 1 


n3(t|t) 


0 0 


where Y(o|o) *• 0 and 


z ■ 

dy(tit) *= ^ (tit) + I 

^ J 


+ [a’ Ctlt)+S(t|t)] [(t)G’ (t)R*^(t) [dz(t)-C(t)C(tlt)dt] 

The key to this result is the fact that K is a state transition matrix with 
a finite-dimensional representation (31) . Also, as mentioned earlier, 
this result can be extended to arbitrary nilpotent Lie groups, some solvabJe 
Lie groups, cuid to other nonlinear systems. The key to these extensions 
is the fact that products and transposes of weighting patterns with finite- 
dimensional realizations also have finite-dimensional realizations (see 
[ 3 ]). 

5.2 The Use of Harmonic Analysis in Suboptimal Filter Design 

In-tbi,s subsection we illustrate the use of harmonic analysis in bi- 
linear estimation by studying a phase tracking problem with the aid of 
Fourier series analysis. For extensions of these results to other problems 
including attitude estimation with the .aid of spherical :h^Lnnonic analysis, 
we refer the reader to [2]. Suppose we receive the signal z defined by 

dz(t) * [sin6(t)]dt + r^^^(t)dw(t) (37) 

d0(t) * w dt + q^'^^(t)dv(t) (38) 

c 

where v and w are independent standard Brownian motions independent of the 
random initial phass 6(0). We desire to track the signal phase, mod 2 tt. 
As discussed in [6], a useful estimation criterion is to choose 6(t) to 
minimize E[l-cos (9 (t)-§ (t) ) |z (s) ,() s ^t)i 

Putting the prbblaa into Cartesian coordinates by defining x^ - sinS, 

X* » COS0 , we have the bilinear equations ^ ; 


dx^(t) 

dx^Ct) 


-q(t)dt/2 


(w^dt+q ^ (t)dv(t))lj (t) 


-(w dt+q ' (t)dv<t)) -q(t)dt/2 




dz (t) » x^(t)dt + r (t)dw(t) 

and the optimal estimate is 

-I 

9(t) “ tan 7? 

x^Ctlt) 

We note that Xj f.inO, — corO /i,o mfrifmiirn ' 
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1 . 


X 2 under the constraint ^2 “ 

To solve this problem, we expand the conditior.al probability density 
for 6(t) given {z(s), 0 £ s £ t} in a Fourier series. The coefficients are 


“ |:jj- Efe |z(hJ , 0<s<tj « b^(t)-ia^(t) 

We then have the coupled equations [6] 

2 

dc = - [inw + “— qlc dt 
n c 2 ^ n 


(c ,-c , 

n-1 n +1 

2i 


) fdz + 2tti (c, )dt' 

- + 27TC I (c, ) S — i 

n m 1 1 . r 


(42) 


(43) 


See [6] for a discussion of the structure of the optimal filter. Note that 
*2 ~ ^ 27 Tc^, and thus we need only compute c^ to determine 6; however, 

couples into into c^, etc. Thus we need to approximate the 

optimal filter to obtain an implementable system. One approach considered 
in tej is to make an approximation based on the assumption that the condi- 
tional density is a "folded normal density/' the circular analog of the 
normal density. The coefficients of such a density depend on only two 
parameters 


2TTC 

n 


= e'" Y/2g-inn 


4441 


and 



2 2 
=1 ■ 


Using this relationship as an Approximation in 


(44), we obtain an equation for that is uncoupled from the other 

coefficients. We refer the reader to [6J for simulation results that in- 
dicate that this filter performs better than the optimal phase- lock loop. 
In addition, directly analogous results using spherical harmonics have 
been obtained in [2] for the estimation of processes on the sphere. 

VI . COWCLUSiaiS 

In this paper we have described a number of techniques for the ana- 
lysis of bilinear stochastic systems. . As t;an be seen from, our results and' 
from those in the references, this is a class of systems that is rich in 
both structure and practical applications- 

References 


1. A.S. Willsky and S.I. Marcus, "Analysis of Bilinear Noise Models in 
Circuits and Devices," Monograph of the Colloquium on the Application 
of Lie Group Theory to Nonlinear Network Problems , 1974 IHED Interna- 
tional Symposium on Circuits and Systems, San Francisco, Calif 
April 1974. 


2. A.S. Willsky and S.I. Marcus, "Estimation for Bilinear Stochastic 
Systems,'' presented at the U.S, -Italy Seminar on Variable Structure 
Systems, Portland, Oregon, Kay 26-31, 1974; also Il.I.T. Electronic 
Systems Laboratory Report ESL-R-544. 


original page ib 




